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Introduction 



With the creation of the Effective Practice Incentive 
Community (EPIC), New Leaders for New Schools hoped 
to accomplish two broad and ambitious goals. The first 
was to identify and reward leadership practices driving 
significant achievement gains in high-poverty, urban 
schools. The second was to learn from those practices 
and make them more widely available, to educators in 
other high-need schools within the EPIC and New Leaders 
communities, and eventually to the broader community of 
educators committed to ensuring success for all students. 

Since 2008, EPIC has awarded $7.4 million dollars to 1 22 
schools where effective practices have led to achievement 
gains — signifying clear progress toward the first goal. 
Recipients include district schools in Denver, Memphis, 
and Washington, D.C., and charter schools across twenty 
states. Funding comes from school partners, a U.S. 
Department of Education Teacher Incentive Fund (TIF) 
grant, and private philanthropies. 

In exchangefor their awards, principals agree to engage 
in a rigorous investigation of practices linked to improved 
achievement. Through structured protocols, interviews, 
and school visits, EPIC guides each school through the 
creation of a school case study or profile that includes 
videos of practices in action, artifacts that document 
the leadership decisions and classroom activities that 
set them in motion, and implementation resources. The 
publication of over 100 of these case studies and profiles 
on the EPIC Knowledge System (http://epic.nlns.org) marks 
an important step toward EPIC's second goal. 

The next step is integrating EPIC resources into 
schools' and districts' ongong leadership development 
programs.This review studies EPIC's Professional Learning 
Model, which is designed to help New Leaders take the 
Knowledge System from a build-it-and-they-will-come 
resource to a guided, field-based professional learning 
experience through which school leaders use the example 
of others to examine their own beliefs and practices and 
lead their own faculty and staff in meaningful change. 

The review outlines the key elements of EPIC's emerging 
professional learning model and positions it within the 
context of the research literature on effective leadership 



development and the National Staff Development 
Council's standards for professional learning. The goal is to 
provide a set of benchmarks that will assist the EPIC team 
in further refinement and implementation of the model. 

Methodology 

New Leaders contracted with Rockman et al, an 
independent research and evaluation firm, to conduct 
the review. Over the last two decades, Rockman et al has 
conducted a number of evaluations, literature reviews, 
and validation studies related to school reform and 
improvement and effective professional development. To 
understand how the emerging EPIC professional learning 
model aligns with the research on effective leadership and 
leadership development, and with national standards, 
Rockman examined both, using the key elements of the 
EPIC model as a starting point. Sources for the literature 
review included publications and journal articles about 
current school leadership efforts, including New Leaders' 
2009 paper on"Principal Effectiveness: A New Principalship 
to Drive Student Achievement, Teacher Effectiveness, and 
School Turnarounds"; meta-analyses of studies related 
to professional learning for effective leadership, such as 
the "School Leadership Study on Developing Successful 
Principals, "commissioned by the Wallace Foundation; and 
the foundational work of well-known figures in the field, 
such as Michael Fullan, John Bransford, Thomas Guskey, 
and Richard Elmore. 

For the standards review, Rockman used the National 
Staff Development Council's (NSDC) process and context 
standards for professional learning. NSDC also sets 
content standards, and it may be possible to review the 
cases on the EPIC Knowledge System in light of these, but 
that was outside the scope of this study. 

Organization of the Review 

Section 1 ofthereviewdescribesthe key components of 
the EPIC professional learning model. Section 2 discusses 
the EPIC model's alignment with the research base, and 
Section 3, its alignment with the NSDC standards. Based 
on this benchmarking process, Section 4 includes "Points 
for Consideration" to inform the continuing refinement 
and development of the learning model. 
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Part I: 



The EPIC Professional 
Learning Model 



The EPIC professional learning model is the natural evolution of a process that begins with the 
identification of schools making significant gains in student achievement. “Significant” is key here, 
and one factor that differentiates the EPIC incentive program and professional learning model 
from other efforts. EPIC looks for significant or breakthrough rather than incremental gains in 
student achievement. The goal is to identify leadership practices linked to marked achievement 
gains, then carefully analyze, document, and ultimately share them with other leaders in high- 
poverty urban schools who need not just tips or formulas but real world examples that serve as 
catalysts for sustained change. 

What is published on the Knowledge System, which debuted in 2008 and now contains cases 
and profiles from over 100 awarded schools, is therefore not a set of quick-fix strategies, but the 
evidence and actions behind the featured practices. In an EPIC professional learning session, 
participants experience a model for how to: 

1. learn on their own in collective, critical inquiry and self-examination in targeted 
areas of personal leadership 

2. use contextualized case study content with their own teachers and staff 



4 • RESEARCH BRIEF 



New Leaders ( for * EPIC 

New Schools^ | Scmm’miKK" 



The key components in the EPIC model are: 

Exposure 

Participants gain exposure to case studies of... 

• over 1 00 carefully selected, rigorously 
investigated effective practices 

• a wide range of schools and real-world 
situations 

• practices that cover the domains of learning 
and teaching, assessment and data, culture, 
aligned staff, personal leadership, and 
operations and systems 

EPIC's professional learning model gives participants a 
virtual, field-based learning experience based on videos 
that show successful leadership and school practices in 
action. Although the EPIC professional learning model is in 
its early stages, the cases are fully developed. 

The cases on the Knowledge System fall into the leadership 
domains identified in the Urban Excellence Framework,™ 
developed by New Leaders for New Schools to identify 
leadership actions taken by highly effective principals. The 
categories are based on evidence gathered during more 
than 60 site visits to schools in 10 cities, and a comparison 
of urban schools making significant gains to those making 
incremental gains. 111 

The power of the EPIC model lies in the opportunity 
for educators to learn not only from one another but also 
from schools that are experiencing consistently high levels 
of student achievement, and from those on the road to 
becoming high-achieving schools. 

Examination 

Participants analyze school leadership practices with the 
aim of identifying... 

• specific, concrete evidence of what makes 
each practice effective 

• personal leadership actions and decisions that 
influence their effectiveness 

Although EPIC believes that the Knowledge System 
resources can help leaders in high-need schools move more 
rapidly through a school improvement trajectory, EPIC does 
not hold up practices for other schools to replicate. The 



cases describe the evolution or tell the story of the effective 
practice. A structured narrative describes how the need for 
the practice was initially identified; what groundwork had 
to be laid; how the tools and routines around the practice 
were developed and implemented; what obstacles were 
met; what was learned in the process; and how the practice 
has been adapted and improved. 

This situated, highly descriptive instruction captures 
explicit and tacit knowledge, serving as a catalyst for change 
rather than offering participants a prescriptive process. 

Reflection 

Participants engage in critical inquiry about how cases 
apply to... 

• their personal leadership approaches 

• their own schools' practices 

• analogous systems, structures, and tools in 
place in their schools 

The EPIC case studies are built from the same blueprint or 
change model as the EPIC investigation and analysis process 
itself — and it is really this change model that participants 
experience. The case studies take them through steps similar 
to the schools whose practices are featured: analyze, reflect, 
plan, and eventually adapt and improve. 

Participants are encouraged to pause, think about the 
ideas, and connect them to their own practice. During the 
sessions, facilitators encourage participants to consider the 
tools and structures in place in their schools, and their own 
personal leadership approaches. 

Planning for application 

Participants develop plans for. . . 

• changes in their own personal leadership 
approach 

• engaging their faculty and staff 

Reflection and critical inquiry are coupled with 
planning for application, which may prompt changes in 
personal approaches to leadership, and deeper changes 
in dispositions and beliefs. Planning for application also 
includes ways to engage faculty and staff. 
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Peer Learning 

Participants learn from peers by engaging in open 
conversation about... 

• what's important to them 

• what's working and not working in their 
schools and why 

Although school leaders can access the Knowledge System 
and take their own self-directed tour through the cases, the 
professional learning model gives them a chance to learn 
and explore with their peers, and engage in critical inquiry 
and decision-making as a shared activity. In a community 
of peers, participants share like experiences and different 
points of view. 

Inquiry-oriented, Socratic Approach 

A facilitator helps participants. . . 

• gain a deep understanding of what makes 
a practice effective in one school and the 
leadership approach that enables the practice's 
successful implementation 

• compare their own practices and leadership 
approaches with those documented in 
EPIC cases as a way to understand how to 
strengthen their school's practice and their 
own personal leadership 

• develop plans for implementing similar 
practices in their own schools 

During interactive analyses of EPIC cases, facilitators 
guide participants through the learning process. It is Socratic 
in nature, and facilitators use questioning as the main tool 
to drive meaningful analysis, reflection, discussion, and 
goal setting. Session facilitators do not instruct participants 
in what to do. Rather, they provide a forum for leaders to 
explore their own leadership approaches and actions. 

Each component and successive step of the EPIC model 
asks participants to engage in what might be termed 
formative studies. Participants assess their own beliefs and 
school practices, consider how practices featured in the 
Knowledge System might be applied to their own situations, 
and put forth evidence and re-examine efforts to see what 
is and isn't working. 



Evaluation 

EPIC uses a collaborative evaluation process designed 
to provide useful information to help school leaders assess 
and advance school change and improvement. That process 
begins in the planning stages with a needs assessment based 
on the specific components of the program (e.g., content, 
delivery model, and duration of the program) and the 
outcomes the program is designed to achieve. In partnership 
with the sponsoring district or Charter Management 
Organization (CMO), EPIC designs a customized evaluation 
plan. EPIC believes strongly in a mixed methods approach 
that provides meaningful information and results. 

Based on the specific program, EPIC offers two types of 
evaluation studies: 

• Impact Study. Impact studies are the highest level of 
proof of a professional development program's success. 
These studies are designed to provide information on 
what knowledge and skills participants gain; how that 
learning affects their leadership beliefs, behaviors and 
decisions; and in turn how those changes in leadership 
affect school culture and other organizational 
structures. 

• Effectiveness Study. Effectiveness studies are 
designed to provide information on participants' level 
of engagement in and reactions to the program, and 
changes in their attitudes, beliefs, and knowledge. The 
data they generate can provide a wide range of feedback 
on implementation, from whether participants are 
engaged in the program and able or likely to put lessons 
into play in their own schools, to whether the support 
and involvement mechanisms are in place within those 
schools to make transfer possible and effective. 
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Part II: 



How EPIC Aligns with 
Current Research on 
Effective Leadership and 
Leadership Development 

This review of selected research looks at what effective school leaders do and what their 
professional learning experiences should provide. In response to new ways of thinking about 
school leadership, researchers and educators have put forth various lists of the “essential 
characteristics” of effective leaders, which include implicit and explicit guidance for leadership 
development. The review of the literature begins with a summary of what the research says 
about professional development characteristics (PDC) for school leaders, then summarizes 
the research on learning environments and delivery methods. The section concludes with a 
review of the research on the role of evaluation in professional learning models. 



Program Content 



PDC #1: 

Professional development should focus above 
all on student learning. 

Most lists of the essential characteristics of effective lead- 
ers call for a clear, steady focus on student learning. The 
emphasis is reflected in the NSDC standards discussed later 
in this review, all of which beg\r\/‘Staff development that im- 
proves the learning of all students. ..." 



The literature also makes a case for focusing on big goals 
and transformative change. In their eight principles of pro- 
fessional learning, Hirsch and Killion call for "ambitious goals" 
that lead to "powerful actions" and "remarkable results ." 121 The 
imperative is especially clear for urban school leadership. 

EPIC Alignment: The vision for the EPIC program consists of 
three interconnected ideas: identifying and rewarding educa- 
tors driving significant learning gains; linking those gains to 
leadership actions; and sharing those practices on the Knowl- 
edge System. As noted in the previous description of the EPIC 
PD model, the Knowledge System shares practices driving 
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significant gains, or gains that have led to breakthroughs 
in student achievement. The Urban Excellence Framework, 
which defines the domains into which practices are divided, 
was also the result of New Leaders' efforts to identify the prac- 
tices taken by "highly effective principals to drive teacher ef- 
fectiveness and student learning outcomes." 131 

The EPIC professional learning model is a means for mak- 
ing these practices available to other urban school princi- 
pals. The Knowledge System content gives them authentic, 
contextualized, rigorously investigated examples of the ef- 
fective actions that school leaders have singled out as the 
key drivers of change. Based on a collaborative needs as- 
sessment, the EPIC team selects case studies that match the 
sponsoring district's or CMO's learning goals, and focuses 
on those during the professional learning sessions — to help 
participating principals create an institutional focus on stu- 
dent learning in their schools. 



PDC#2: 

Professional development should help school leaders 
develop shared values and accountability among faculty 
and staff. 

Kevin McGuire, Director of the University of the State of 
New York's Center for School Leadership, sees leadership as 
"the act of identifying important goals and then motivating 
and enabling others to devote themselves and all necessary 
resources to achievement.""lf vision articulates the end," state 
DuFour and Berkey, "shared values represent the means that 
are necessary to move the school toward that target." 141 

Most educators studying effective leadership agree on the 
need for shared purpose. Many also agree with Fullan and 
colleagues that a "collective moral purpose" must be accom- 
panied by a shared "responsibility for change,"or what Hirsch 
and Killion call "accountability for achieving big goals." 151 

EPIC Alignment: Implicit in EPIC's awards, and the dissemi- 
nation of leadership practices contributing to significant 
gains through the Knowledge System and professional learn- 
ing model, is the assumption that the gains are the result of 
collective effort and shared accountability. Similarly, while 
New Leaders'definition of effective school leadership under- 
scores the critical importance of principal actions in steer- 
ing failing schools toward success, it also says that "whole 
schools" should be "high-functioning." 161 



During the reflection and planning for application, and 
during peer conversations and facilitator-led Socratic dia- 
logue, EPIC professional learning sessions move partici- 
pants' attention from the practices featured in the Knowl- 
edge System to the practices in place in their own schools. 
This process asks them to consider the changes in beliefs 
and approaches that may need to occur to develop a sense 
of shared accountability among their own faculty and staff. 



PDC #3: 

Professional development should help school 
leaders use data to set and measure goals. 

The research often pairs calls for visionary leadership with 
the need to ground goals in data-driven practice. Fullan, 
Quinn, and Bertani, for example, state that effective lead- 
ership requires building powerful "assessment for learning 
capacities that involve the use of student data for school 
and district improvement." McGuire concludes that effec- 
tive leaders "use data to determine the present state of the 
organization, identify root-cause problems, propose solu- 
tions, and validate accomplishments." A recent review of the 
qualities and impact of development programs also found, 
among exemplary programs, both an intense focus on de- 
veloping instructional leadership and a reliance on data and 
evidence. 171 

A call for school- and district-wide use of data to set and 
confirm direction reflects the systems thinking urged by The 
Fifth Discipline author Peter Senge and others. It also ad- 
dresses a need to introducethis practice in principal prepara- 
tion and professional development programs, which, in their 
2003 review, Hale and Moorman found to be too theoretical 
and lacking in opportunities for leaders to develop practical 
skills and real-world competence. 181 

EPIC Alignment: The EPIC model strengthens the link be- 
tween data and big goals in two important ways. First, the 
Knowledge System cases are chronicled with data, concrete 
evidence, and key artifacts that highlight the centrality of 
data and evidence in achieving goals. The investigations 
behind the Knowledge System are designed to define these 
leadership actions, portraying not symbolic leadership but 
leadership in action. In the videos, featured principals also 
talk about their data-driven, results-oriented practice. 
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Second, the EPIC professional learning model reinforces 
the link between goals and data by specifically asking partic- 
ipants to examine leadership practices — those featured on 
the Knowledge System and their own — with the aim of iden- 
tifying concrete evidence of what makes those practices ef- 
fective and indentifying what's working and not working in 
their schools and why. 



PDC #4: 

Professional development should align with 
school needs as well as goals, and help school leaders 
identify takeaways and potential applications. 

Fullan observes that administrators often apply lessons 
from professional development but that sometimes the 
"wrong thing is being replicated." Bryk et al refer to "Christ- 
mas tree schools" that, in undertaking multiple initiatives, 
don various, even unrelated elements of professional devel- 
opment. [9] The challenge may lie less in the takeaways from 
the professional development than in the identification of 
the need they are presumed to address. In a study for the 
National Governors' Association, Richard Elmore maintains 
that, "knowing the rightthing to do is the central problem of 
school improvement ." 1101 

EPIC Alignment: The EPIC professional development model 
includes an evaluation component designed to track a pro- 
gram's success towards meeting stated goals and objectives. 
This step can help ensure that professional development 
participants get what they need. 

Perhaps more important, the reflection and planning el- 
ements of the EPIC model require participants to think in 
terms of their own schools and practices. The experience 
mirrors the investigation behind the Knowledge System cas- 
es, which pays close attention to the fit between the identi- 
fied need, the tools and routines around the practice, and 
the results. With selected cases as a starting point, partici- 
pants look first at their own personal beliefs or approaches 
needed to reach learning goals, then at ways to engage staff. 
They can use the Knowledge System cases as a springboard 
for staff conversations, and their own EPIC-based profession- 
al development experience as a model. The process has the 
potential to bring coherence to professional development 
and its application. 



PDC #5: 

A close consideration of local context and the structures 
and tools in place should be part of the professional 
development content. 

Even as it emphasizes the importance of applying profes- 
sional learning, the research also cautions that it may not 
apply in all conditions. As Hirsh and Killion stress in their re- 
view of the application of professional development, "context 
matters" when school leaders transfer professional learning 
to their own schools. In his discussion of lessons about dis- 
trict-wide reform, Fullan says that effective leaders need "the 
structures, roles, and role relationships that represent the best 
arrangement for improving all schools in the district ." 1111 

EPIC Alignment: The reflection component of the EPIC 
model specifically includes looking at the "analogous sys- 
tems, structures, and tools in place." In doing so the model 
can help participants think about their schools' readiness. 
EPIC also invites participants to think about their own per- 
sonal leadership roles, making their personal beliefs part of 
the context in much the same way that actions are part of 
the data. 

EPIC session facilitators make it clear that it is not a pre- 
scriptive learning model, and that participants shouldn't ex- 
pect to leave with a simple set of strategies they can apply 
in their own schools. The Knowledge System cases don't of- 
fer readymade solutions, but serve as a starting or reference 
point for participants to examine their own schools. 



PDC #6: 

Professional development should give participants the 
tools to share leadership and build capacity among 
faculty and staff. 

While the research often identifies leadership as the single 
most important factor in creating effective schools, it also 
acknowledges that leadership rarely resides with a single in- 
dividual . 1121 There are numerous ways of looking at shared 
leadership: Elmore calls it"de-romanticizing leadership, "and 
Bryk calls it the "de-privatization of practice" . 

Most lists of the qualities or requirements for effective 
leadership include the value of building capacity to imple- 
ment and achieve change. In a RAND Change Agent Study, 
Berman and McLaughlin cite strong leadership and the in- 
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volvement of teachers as not just valuable but necessary 
for institutionalizing implementation. [13] In their ten lessons 
about district-wide reform, Fullan et al list a "commitment to 
capacity-building strategies," noting that the "main mark of 
successful leaders is not their impact on student learning at 
the end of their tenure, but rather the number of good lead- 
ers they leave behind who can go even further." 1141 The lit- 
erature also stresses the importance of ongoing professional 
growth within schools, and the need to solve problems with 
"internal expertise." As Hirsch and Killion note, both "context" 
and "capacity" matter. 1151 

EPIC Alignment: The idea of distributed leadership is implic- 
it in many of the Knowledge System cases and profiles, where 
principals describe their efforts to engage school leadership 
teams, departmental chairs, or the larger school community 
in shared discussions and practice. The importance of build- 
ing capacity is also closely tied to New Leaders' emphasis on 
aligned staff and their model of effective leadership as "hu- 
man capital management." 1161 

While the video cases may give principals an idea or strat- 
egy for involving teachers or constituting a leadership team, 
the more broadly transferable skill from the"planning for ap- 
plication" component of the EPIC model is a way of engaging 
teachers in critical inquiry about their practice. Asking hard 
questions of themselves and teachers about practices or be- 
liefs, and the dialogue that ensues, are critical components of 
shared leadership. 



PDC #7: 

Developing capacity and sharing leadership means 
functioning as a professional learning community. 

The literature on capacity building and distributed leader- 
ship often dovetails with the growing body of literature on 
professional learning communities, which has helped define 
how professional development is conceived, provided, and 
applied in schools. The idea itself is not new: the term "profes- 
sional learning communities" dates back to the 1960s, but it 
was in the 1 990s that researchers like McLaughlin, Newmann 
and Wehlage reported that schools should operate like pro- 
fessional communities, with shared norms and beliefs, col- 
laborative cultures, and collective responsibility for the learn- 
ing of all students. Other leaders in the field include Fullan 
and Richard DuFour and Robert Eaker, whose Professional 



Learning Communities at Work has become a standard text 
for school leaders and teachers. 1171 

EPIC Alignment: An EPIC session models the process that 
leaders will take back to their schools and engage in with their 
faculties, which can help leaders build the skills necessary for 
a collaborative culture. The EPIC model also encourages peer 
learning, so that the session creates a learning community in 
which participants engage in inquiry and reflection and frank 
discussions of goals and challenges. This community has val- 
ue not only as a model but also as a district- or CMO-wide 
community that can give school leaders a broader perspec- 
tive, peer support, and locally specific ideas for addressing 
shared goals and challenges. 



PDC #8: 

Professional learning experiences should give school 
leaders opportunities to develop habits of critical inquiry 
and reflection, and consider how to engage their own 
faculties in reflective inquiry. 

Current research on and prescriptions for effective leader- 
ship development stress the value of imparting "habits of re- 
flection and critical analysis." 1181 DuFour and Berkey contend 
that this not only builds community but also models a com- 
mitment to professional growth." 1191 

EPIC Alignment: Critical inquiry and reflection are embed- 
ded throughout the EPIC model. By taking part in what ef- 
fectively serves as a learning community, and in considering 
their own school communities, participants are encouraged 
to examine what isn't working and what is working, always 
with an eye to the pivotal role leadership does or could play, 
beliefs and attitudes that may impede or support success, 
and ways to learn from practice. 



PDC #9: 

Critical inquiry should explore differences 
as well as points of agreement. 

The literature is clear: inspiring and implementing change 
is not always easy. McGuire notes that even as they embrace 
informed, planned change, leaders must recognize that not 
everyone may support it. A McREL study on balanced leader- 
ship looked at the magnitude of change, and defines "change 
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of the second order" as change that require leaders to "work 
more deeply with staff and the community, "which may mean 
conflict, disruptions, and changing working relationships. 1201 

Fullan et al write that though conflict is inevitable when 
difficult change is attempted, the opportunity to explore dif- 
ferences can also be productive. In this same vein, Hirsch lik- 
ens the process to what Doris Kearns Goodwin calls Lincoln's 
"team of rivals." In discussing the value of looking at personal 
beliefs, Hirsch and Killion say that "For deep change to occur 
and for transformational learning, the system must have open 
communication that allows all members to draw attention to 
inconsistencies in espoused beliefs and beliefs-in-actions." [211 

EPIC Alignment: Access to the Knowledge System allows 
EPIC participants to see how other leaders and schools form 
and function as communities of practice, which includes 
dealing with disagreement. As participants in an EPIC profes- 
sional learning session engage in conversations with peers, 
they can use that experience to examine, clarify, defend, and 
even begin to change their beliefs and approaches — and 
gain insights on how to establish norms of collegiality that 
embrace productive conflict. This exercise of critical inquiry, 
followed by interactions with peers, previews conversations 
with faculties and has the potential to prepare participants 
for and support the second order of change. 

Adult Learning Theory 



PDC #10: 

The learning strategies employed in professional learning 
experiences should accommodate the needs of adult 
learners. 

Research on how adults learn has influenced how leader- 
ship development is designed and delivered. Again, the ideas 
have been around for some time — the oft-invoked Socratic 
method goes back to the Greeks — but the current interest 
dates to 1973, with Malcolm Knowles' The Adult Learner: A 
Neglected Species. More recently, John Bransford's How Peo- 
ple Learn: Brain, Mind, Experience, and School renewed inter- 
est in how adults process information and how they should 
be schooled. 1221 

Typically listed among the key factors that support adult 
learning are flexibility, active involvement, and intellec- 



tual challenge — stemming from the fact, as Knowles main- 
tained, that adults are self-directed and want to know why 
they need to learn something. More so than younger learn- 
ers, they come to learning environments with pre-existing 
learning histories, prior experiences, and achievements, all 
of which should be acknowledged and accommodated. 1231 

EPIC Alignment: The Knowledge System allows for flexible, 
self-directed learning. What the EPIC sessions provide is the 
active involvement and the intellectual challenge that come 
from inquiry and dialogue and the in-depth, iterative com- 
parison of personal leadership beliefs and approaches and 
those portrayed in the Knowledge System cases. Knowledge 
taught in a variety of contexts, says Bransford, is more likely 
to support flexible transfer, and allow learners to extract 
relevant concepts. 1241 The videos used in EPIC professional 
learning sessions locate practices in the multiple, authentic 
contexts that Bransford supports; and the prior experiences 
that school leaders bring to the discussions around the vid- 
eo cases situate practices in additional contexts. 



PDC #11: 

Adult learners need scaffolding, regular feedback 
mechanisms, opportunities for collaboration and 
teamwork, and an opportunity to apply new knowledge 
in real-world situations. 

Research suggests that although adults value self-direct- 
edness in learning opportunities, they also place high value 
on communication and collaborative learning environments 
where they can articulate, reflect on, and share experiences. 1251 

A more recent incorporation of adult learning theory is 
in Richard Elmore's notion of "instructional rounds," which 
is based on doctors' rounds and the success of problem- 
centered learning and sustained ongoing support for adults. 
This and other research suggests that adults need to apply 
what they've learned "toward the resolution of "real-world 
problems and dilemmas." 1261 Bransford, too, says that experi- 
ences should be community-centered as well as learner- and 
knowledge-centered. 

The research suggests that blended models can accom- 
modate adult learning needs and schedules. Bransford 
notes that one of the ways technology can be used to help 
establish effective learning environments is infringing real- 
world problems"into the classroom through video and simu- 
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lations. 1271 In a 2004 study of learning environments, Ausburn 
found that those most valued by adult learners combine 
face-to-face contact with web-based learning. 1281 

EPIC Alignment: The EPIC model is a blended model. In 
face-to-face sessions, facilitators can provide scaffolding and 
mediate a forum where participants can explore their own 
leadership approaches and actions. The conversations with 
peers add sharing, feedback, and collaboration to the virtual 
problem-based learning. School leaders can also access the 
Knowledge System on their own to explore new cases, or re- 
visit a case after a session with their own faculty and staff. 



PDC #12: 

Group affiliation or cohort identity can strengthen 
professional learning. 

Some research also suggests that interaction, collabora- 
tion, and sharing should take place among a cohort group. 
Adults need, for example, "group affiliation" when they en- 
gage in professional development activities, and one study 
found that teachers gave higher ratings to the leadership 
practices of principals who participated in cohort training. 1291 
The Stanford School Leadership study, which identified eight 
exemplary professional development programs, also noted 
the positive impact of an integrated experience for program 
participants. The findings indicated that cohorts were not 
simply a way to group candidates, but also served as a ped- 
agogical tool to "teach teamwork, develop a sense of com- 
munity as learners, facilitate deep and durable peer support 
networks, and model distributed leadership." 1301 

EPIC Alignment: EPIC does not specify cohort grouping in 
its professional learning model, though district-wide par- 
ticipation and immersion in the model through successive 
sessions can build a similar sense of affiliation. In the needs 
assessment, EPIC could also stress the importance of a sus- 
tained, integrated experience for school leaders, and define 
other sources of affinity — grade level, school need, stage of 
improvement — that could support collegiality and add dif- 
ferent dimensions to the analysis of cases. 

Evaluation 

The growing need for and investments in leadership devel- 
opment, along with expanding options, have led to a greater 
need for evaluation. Participants, providers, and stakeholders 



need to know, "does it work?" Including evaluation can also 
help ensure that the professional development occurs as de- 
signed and intended. As NSDC president Stephanie Hirsch 
notes, "What gets measured gets done." 1311 



PDC #13: 

Evaluation should be incorporated into the planning of 
professional learning. 

In 2002, NSDC released "What Works," a series of reports 
on assessing effective professional development programs, 
which found that effective programs are "research-based, 
have curricular coherence," and exhibit the "features of pro- 
fessional development programs most frequently identified 
in the literature as being essential to the development of ef- 
fective school leaders." [321 Conducting evaluation from the be- 
ginning of a professional development can model the kinds 
of data-driven decisions promoted in the training itself. It can 
capture participants' reactions but also their learning and it 
can determine whether and how that learning was applied, 
and what impact it had. 

EPIC Alignment: EPIC proposes a collaborative evaluation 
model with the potential to help school leaders both as- 
sess and bring about school change. The model includes a 
needs assessment based on specific program components 
and desired outcomes, from which emerges a customized 
evaluation plan. The plan could focus, for example, on the ef- 
fectiveness of the professional development, providing infor- 
mation about engagement, reactions, and changes in beliefs 
and knowledge; or, it could focus more on impact, looking at 
changes in beliefs and knowledge while addressing changes 
in school culture and organizational structures as well. 



PDC #14: 

Evaluation can help districts and schools assess and 
monitor progress, and see not only what professional 
development best equips school leaders but also what 
support and structures best ensure appropriate and 
successful implementation. 

DuFour and Berkey write, that "if the school has under- 
taken an initiative to 'alter the professional practice, beliefs, 
and understandings' of the faculty, the principal must moni- 
tor whether or not the desired change is taking place." 1331 
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Thomas Guskey, who has written widely on professional de- 
velopment, proposes a five-level model for evaluation. The 
first level looks at participants' reactions and assesses basic 
needs — did participants like the training, and what new 
knowledge or skills did they gain? Level two explores wheth- 
er participants acquired "the intended knowledge and skills," 
and level three includes contextual factors: what is the level 
of organizational support, what resources were made avail- 
able, what was the impact on the organization, and how did 
the professional development influence what participants 
did on the job? Level four turns to the critical question of ap- 
plication, asking, "Did participants effectively apply the new 
knowledge and skills?" The fifth and final level asks, "What 
was the impact on students ?" 1341 

In an article entitled "Building an Evaluation Tool Kit for 
Professional Development," Buher-Kane, Peter, and Kinnevy 
propose adding a sixth level, which they call "extension," to 
encourage more follow-through and a longer-term look at 
the ripple effects of professional development . 1351 

EPIC Alignment: The evaluation studies suggested in the 
EPIC model are designed to explore how the professional 
learning experiences affect participants' knowledge and 
skills; how they affect their leadership beliefs, behaviors and 
decisions; and in turn how those changes in leadership affect 
school culture and other organizational structures. 
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Part III 



How EPIC Aligns with the 
National Staff Development 
Council's Standards for 
Professional Development 

Research suggests that as schools look for ways to evaluate professional development and 
justify their investments, one criterion is whether programs align with national standards. 
This section looks at the alignment of the emerging EPIC model with the standards 
authored by the National Staff Development Council (NSDC), which has, for the last 
decade, looked at schools and school systems producing significant gains for students. 

NSDC’s purpose, and the premise implicit in the standards that have grown out of 
their work with schools, is as simple as it is comprehensive: “Every educator engages in 
effective professional learning every day so every student achieves.” The title of a recent 
Kappan article by current president Stephanie Hirsch says it even more simply, but no less 
emphatically: “When Educators Learn, Students Learn.” 



14 • RESEARCH BRIEF 



New Leaders ( for | EPIC 

New Schools^ | StoLSKI" 



Context Standards 

The first of NSDC's three context standards calls for staff 
development to organize adults into learning communities 
whose goals are aligned with those of the school and district. 
The importance of shared goals and "new ways of profes- 
sionals working together" was clear in the literature and is 
equally apparent in the EPIC model. EPIC sessions model 
communities of practice and encourage participants to rec- 
reate them within their own schools. Through video cases 
and the examples of others, participants consider their own 
school goals and practices and ways to foster shared values 
and collective responsibility. 

The second standard stresses the importance of leader- 
ship in staff development. Skillful school and district leaders 
who guide continuous instructional improvement must be able 
to articulate not only "the critical link between leadership 
and instructional growth" but also the varied links between 
"improved student learning and the professional learning of 
teachers." Even as school leaders distribute leadership respon- 
sibilities to faculty who forge those links, they examine, and 
re-examine, "their own values and beliefs" and their effect on 
achieving "organizational goals." Effective instructional leader- 
ship is at the core of the EPIC initiative and the professional 
learning model. As the standard proposes, participants exam- 
ine their beliefs, their leadership approaches, their plans — and 
the role they play in creating a strong school culture focused 
on improved instruction and achievement. 

Although the collective responsibility for improved learn- 
ing is internal, NSDC makes a strong case for investing in 
resources to support adult learning and collaboration. As 
one investment option, EPIC offers multiple adult learning 
resources — virtual field experiences, self-directed and facili- 
tated sessions, peer learning opportunities, and other pro- 
fessional learning practices that school leaders can take back 
to their own schools. The Knowledge System's rich repository 
offers a wide variety of resources designed to accommodate 
the full range of adult learning needs. 

Process Standards 

The first process standard relates to the use of disaggre- 
gated student data in staff development, not only to moni- 
tor progress but also to determine adult learning priorities and 
help sustain continuous improvement. The EPIC model and 
Knowledge System make frequent reference to the critical 



importance of using data to chart the course of school im- 
provement. Though the EPIC model does not make explicit 
reference to using student data to determine teachers' pro- 
fessional learning needs, individual Knowledge System cases 
offer detailed examples. 

Staff development should also, according to NSDC, draw 
on multiple sources of information to guide improvement and 
demonstrate its impact. EPIC's model of incorporating eval- 
uation — even in the planning stages — and gathering data 
throughout aligns closely to the NSDC standard. NSDC also 
emphasizes collecting more than "participants' immediate 
reactions to workshops and courses," and extending evalu- 
ation to participants' "acquisition of new knowledge and 
skills."The evaluation component of the EPIC model repeat- 
edly asks school leaders how learning transfers to or affects 
practice, and how their experiences affect school culture 
and organizational structures. 

The fourth standard proposes that staff development 
prepare educators to apply research to decision making. NSDC 
cautions that research can mean different things to different 
people. School decision makers should become "informed 
consumers," clear about what they mean by "research- 
based," what research can tell them, and when they should 
conduct their own pilot studies to validate efforts. The EPIC 
model likewise encourages educators to base decisions on 
research. The Knowledge System contains a storehouse of 
qualitative data on leadership and instructional practices, 
along with archival evidence and quantitative school data. 
This internal research base can serve as a benchmark for us- 
ers and professional development participants as they per- 
form their own data collection and validation of practice. 

Two additional process standards urge educators to in- 
corporate learning strategies appropriate to the intended goal 
into their staff development and apply knowledge about hu- 
man learning and change, noting that effective — and often 
the most powerful — programs combine different learning 
strategies and delivery methods. What is important, accord- 
ing to NSDC, is that"staff development leaders and providers 
select learning strategies based on the intended outcomes." 
The EPIC blended model gives participants virtual field- 
based learning experiences and multiple opportunities for 
peer learning, inquiry, and reflection; it also allows schools or 
districts to tailor sessions to learning needs. Participants can 
also visit the Knowledge System on their own and engage in 
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self-directed learning. EPIC also meets NSDC's requirement 
for adult learning that promotes "deep understanding" of 
a topic. 

Coming full circle back to the emphasis on learning com- 
munities, NSDC calls upon staff development to provide edu- 
cators with the knowledge and skills to collaborate. EPIC's face- 
to-face sessions and those that participants convene with 
their own faculties address this standard, and, in concert 
with the Knowledge System, can help participants "become 
effective at performing the group's work in a manner that 
satisfies both the task and interpersonal expectations of par- 
ticipants." NSDC also offers two caveats: First, that this kind 
of group work is a phased process that requires a long-term 
commitment; second, that leaders should guard against a 
"pseudo community" or "contrived collegiality," and engage 
participants in "candid conversations... essential in reaching 
consensus on long-term goals and strategies and in finding 
solutions to the perennial problems of teaching and school 



leadership." EPIC, too, emphasizes candid self-study and dis- 
cussion, and provides facilitators who help groups as they 
navigate what NSDC calls "unfamiliar waters." 

Both the context and process standards signal the grow- 
ing role of technology in staff development. NSDC recom- 
mends virtual networks, electronic formats, distance tech- 
nology, and various media that enable learning throughout 
the day and in various settings. While promoting new tech- 
nologies that allow teachers and administrators with differ- 
ent learning preferences to share ideas, strategies, and tools, 
NSDC does not shy away from the fact that electronic forms 
may also present teachers and administrators with chal- 
lenges "whose outlines are only becoming dimly visible as 
larger numbers of educators begin to use these processes 
to strengthen their teaching and leadership practices." With 
its blended model and video cases, EPIC meets the call for 
incorporating new technologies. 
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Part IV: 



Points for Consideration 

The reviews indicate that, in its broad outlines, the EPIC professional learning model 
aligns comfortably with both the research and the standards. The central argument of 
both— that schools need skilled leaders who focus on helping all students learn, use data to 
set and measure goals, create strong communities of practice among faculty and staff, and 
model critical inquiry and ongoing learning— are reflected in the model’s design and chief 
resource, the EPIC Knowledge System. 



There are also features in the EPIC model that differentiate 
EPIC from other models and resources. The points below are 
intended to inform the further development of the model, 
and suggest features or capabilities the EPIC team might em- 
phasize in dissemination and implementation efforts. 

1 . EPIC focuses on significant gains in achievement, effec- 
tive practices, and the real issues principals face during 
all stages of school improvement. Although these fea- 
tures differentiate EPIC from other professional develop- 
ment models, the distinctions are subtle and may be lost 
in implementation planning. For school, district, or CMO 
leaders and professional development planners to fully 
understand what EPIC offers, it may be important, for ex- 
ample, to reference the research on the value of focusing 
on fewer but more pressing goals — on the "ambitious 
goals" linked to "powerful actions." Similarly, pointing 
out the differences in a model that showcases "effective" 
as opposed to "best" practices, or portrays leadership 
practices instituted in the early rather than later stages 
of school turnaround, may help potential users see what 
EPIC offers, and, with the EPIC team, select cases from 



the Knowledge System that best align with school goals. 

2. The research and standards leave no doubt that goals 
should be grounded in data and evidence, but there may 
be a tendency in professional development sessions to 
keep them separate, with some sessions devoted to set- 
ting goals and others to analyzing data. EPIC, and the 
Knowledge System, make the links more visible and rein- 
force the interconnectedness of learning goals, practice, 
and evidence, and the need for a systems approach to 
improving achievement. Again, in planning the imple- 
mentation of the EPIC professional learning model, the 
EPIC team could emphasize the importance — and the 
uniqueness of the EPIC model — of examining evidence, 
leadership actions, school structures, and implementa- 
tion plans in a single session. 

3. It may be valuable to engage schools, districts, and 
CMO's in a discussion of how the transfer from PD ses- 
sion to school should work, early on and throughout the 
process, revisiting goals, experience, support, and advo- 
cacy. This is a part of the model, but ongoing conversa- 
tions about what participants take away and put to work 
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in their own schools could add clarity and ensure appli- 
cation, and at the same time allow for changing needs, 
new input, or unanticipated challenges. Although the 
goal of the needs assessment is to tailor the EPIC ses- 
sions to specific needs, at the front end of the process it 
may not be possible for schools leaders and professional 
development planners to anticipate what participants 
will gain from the sessions. It may be valuable to revis- 
it the fit between session content and school needs in 
ongoing or periodic conversations with stakeholders as 
well as participants. 

4. One thing that comes through repeatedly in the research 
and standards is that professional development must 
be continuous, just as forming learning communities, 
sharing goals and leadership, and ultimately improving 
achievement is an ongoing process. As EPIC plans with 
schools, districts, or CMO's to employ the model, it may be 
valuable to outline and strongly encourage a phased pro- 
gram, whereby schools or districts sign on to a long-term 
commitment or ongoing process through which efforts 
are revisited and successively analyzed. Successive phas- 
es need not necessarily involve adding on EPIC sessions. 
It in fact may be more important to define phases by the 
degree to which EPIC transitions professional learning to 
schools and districts, which replicate the EPIC model with 
their own faculties and staff. Stressing the importance of 
a sustained activity could not only build local capacity but 
also secure further dissemination and sustainability of the 
EPIC model. 

5. EPIC doesn't incorporate the lateral capacity making that 
Fullan says strengthens connections within and across 
districts. As the EPIC team disseminates the model, one 
strategy may be to recommend that schools, districts, or 
CMO's with similar composition, challenges, and goals 
look at shared sessions wherein they build capacity with- 
in and across institutions. This strategy could give users 



a different way to look at investment in the professional 
learning process and leverage resources and results. It 
could also help the EPIC team disseminate more widely 
and develop new models of implementation. 

6. As the EPIC team plans with schools, districts, or CMO's, 
they should emphasize the value of evaluation. The re- 
search and the standards clearly support this, as a way 
to justify investments and understand how professional 
learning is put into play and what changes emerge. If 
changes do not come about, it is equally important to 
understand what stands in their way. Guskey's model 
may be a useful one that districts or participants can use 
for self-study, to frame and evaluate their investment in 
the EPIC model. 

7. It may be important to reference the research in shar- 
ing the model with educators and potential users, for 
two reasons. First, educators and potential users need 
to understand the model and how it compares to other 
resources: in a market where there are a number of for- 
mulaic or prescriptive programs, potential users should 
see the features that characterize EPIC or set it apart. 
Second, it is important to offer educators who are invest- 
ing or taking part in a professional learning experience 
reassurance that it is research-based. Some participants 
may be especially interested in consulting the research 
further. 

8. Consider an online forum or sharing mechanisms for 
participants to continue conversations begun in EPIC 
professional learning sessions. The research and stan- 
dards support using technology as a collaborative tool. 
Again, this could be more of a district or CMO effort than 
an EPIC initiative. Although this is not part of the current 
learning model, EPIC could incorporate this functional- 
ity into the Knowledge System, or into its learning model, 
extending conversations between and beyond the ses- 
sions and reinforcing learning communities. 
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MetLife Foundation 



MetLife Foundation supports education, health, civic and cultural organizations. It seeks to in- 
crease opportunities for young people to succeed, encourage leadership development for teachers 
and principals, and connect schools, families and communities. Its funding for education is informed 
by findings from the annual MetLife Survey of the American Teacher. For more information visit www. 
metlife.org. 



New Leaders for New Schools ensures high academic achievement for every student by attracting 
and preparing outstanding leaders and supporting the performance of the urban public schools they 
lead at scale. New Leaders was founded in 2000 and operates today in ten cities: Bay Area (CA), Balti- 
more, Charlotte, Chicago, Memphis, Milwaukee, Greater New Orleans, New York City, Prince Georges 
County (MD), and Washington, DC. More than a principal training program, New Leaders for New 
Schools is a national movement of leaders with an unwavering commitment to ensure that every 
student achieves academic excellence. For more information visit www.nlns.org. 



THE EFFECTIVE PRACTICE 
INCENTIVE COMMUNITY 

The Effective Practice Incentive Community drives student performance by rewarding educa- 
tors in schools making student achievement gains for sharing effective practices with colleagues in 
their own district and with educators across the country. The EPIC program was founded in 2006 by 
New Leaders for New Schools and operates in partnership with the Denver Public Schools, District of 
Columbia Public Schools, Memphis City Schools, and a consortium of more than 140 charter schools 
across the nation. As of March 201 0, more than 1 00 case studies and profiles of EPIC awarded schools 
are available on the EPIC Knowledge System. For more information visit www.nlns.org/epic.jsp. 



Independent • Insightful Informative 

Rockman et al is an independent research, evaluation, and consulting firm focusing on education, 
technology, and media. Rockman works with preschool, K-1 2, postsecondary, and adult educational in- 
stitutions on formal educational initiatives, and with museums, foundations, private industry, and other 
groups on informal education initiatives. Rockman has often served as external evaluator for projects 
funded by grants from the U.S. Department of Education and the National Science Foundation. 
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For more information about the Effective Practice 
Incentive Community, please contact us at epicinfo@nlns.org 

or visit us at www.epic.nlns.org. 

For more information about New Leaders for New Schools, 
please contact us at info@nlns.org or visit us at www.nlns.org. 
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